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We study the asymptotics related to the following matching cri¬ 
teria for two independent realizations of point processes X ~ X and 
y ~ Y. Given Z > 0, X n [0, Z) serves as a template. For each Z > 0, the 
matching score between the template and Y n [Z,Z -I- Z) is a weighted 
sum of the Euclidean distances from y — t to the template over all 
y €Y n [Z,i -I- Z). The template matching criteria are used in neu¬ 
roscience to detect neural activity with certain patterns. We first 
consider Wi{d), the waiting time until the matching score is above 
a given threshold 9. We show that whether the score is scalar- or 
vector-valued, {l/l)logWi{6) converges almost surely to a constant 
whose explicit form is available, when X is a stationary ergodic pro¬ 
cess and Y is a homogeneous Poisson point process. Second, as Z —> oo, 
a strong approximation for — log[Pr{W;(0) = 0}] by its rate function 
is established, and in the case where X is sufficiently mixing, the 
rates, after being centered and normalized by VI, satisfy a central 
limit theorem and almost sure invariance principle. The explicit form 
of the variance of the normal distribution is given for the case where 
X is a homogeneous Poisson process as well. 

1. Introduction. In neuroscience, it is well accepted that neurons are the 
basic units of information processing. By complex biochemical mechanisms 
governing the ion flows through its membrane, a neuron generates very nar¬ 
row and highly peaked electric potentials, or “spikes,” in its soma (main 
body) [6]. These spikes can propagate along the neuron’s axons, which are 
cables that extend over relatively long distance to reach the other cells. The 
spikes can then influence the activities of those cells. The temporal pat¬ 
tern in which a neuron generates spikes dynamically depends on its inputs, 
which are either stimuli from the environment or biochemicals induced by 
the spikes from the other neurons. In this way, information is processed 
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through the neural network. Because spikes are very narrow and peaked, 
point processes are the most commonly used models for neuronal activity, 
with points representing the temporal locations of spikes. 

For many studies in neuroscience, it is necessary to detect segments of 
neuronal activity that exhibit certain patterns [1, 10, 11]. Recently, in a 
study on the activity of brain during sleep, a template matching algorithm 
was developed which uses linear filtering to quickly detect such segments 
(cf. [3]). The algorithm is template based. Suppose 5 = {xi,...,is a 
nonempty sequence of spikes generated by a neuron under some specihc 
condition between time 0 and 1. This sequence is used as a template. Given 
a data sequence of spikes Y = {yi,y 2 , ■ ■ ■} generated by the same neuron but 
at a different time, the goal is to find segments in Y that have a temporal 
pattern similar to S. To do this, for each time point t, collect all y’s between 
t and t + I and shift them back to the origin. If the temporal distances 
between the shifted y’s and S are small on average, then it indicates that 
the temporal pattern of the activity recorded in Y between t and t + I is 
similar to that of S. Therefore one can use the following matching score 

M{t) = j fid{y-t,s)) 

y between t and t-\-l 

to measure the overall distance, where /(x) is a function of x > 0 that 
is nonincreasing, and d is the Euclidean distance such that for any y G M 
and 5 C M, d{y,S) = inf{|y — s| :s G A}. Let 0 be a threshold value fixed 
beforehand. If M{t) > 6, then output t as a location of matching segment, 
or “target.” To improve accuracy, the detection was modified to involve 
multiple matching criteria so that both / and 9 are vector-valued. Then t 
is a target location only if M{t)>9 (cf. [3]), where, for u = (tti,... ,«„) and 
u = (ui,..., u„), “u > u” denotes “uj > Vj for all j.” For later use, let “u > u” 
denote “u > v and u / u.” 

In the above studies, it is necessary to evaluate how difficult it is to get 
false targets if a data sequence is noise. A useful criterion for this is the wait¬ 
ing time until the matching score is larger than or equal to 9. Presumably, 
when the template is longer, that is, I is larger, it would be more difficult 
to find false targets. But how much more difficult? In this article, we study 
the asymptotics of the waiting time under certain assumptions on the point 
processes underlying the template and the data. 

To fix notation, realizations of a point process on M will be regarded as 
point sequences. For a <b and 5 C M, denote 

S^ = Sri[a,b), S — a = {t — a: a € S}. 

We will think of the template S as an initial segment of an infinite se¬ 
quence X of points on M. That is, S = Xq for some I > 0. Given / = 
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(/i,..., fn): {0} U M —if Y is another sequence of points, then for each 
t>0, define 




y E f{d{y-t,Xi)), if 

y6y/+' 

(—oo,..., —oo), otherwise. 


In practice, it is reasonable to require that /fc(x), A: = l,...,re, be non¬ 
increasing functions in x > 0. However, to get the asymptotics of W, this 
requirement can be dropped. Given a threshold 0 G M”, the waiting time 
until the first false target is detected is 

Wi(0,X,Y)= inf{t > 0: pi(X‘,Y/+‘) > 6}. 


To study the asymptotics of Wi as I increases, assume X and Y are 
random realizations of two point processes X and Y on M, respectively. One 
would think of stationary Poisson point processes as signals that contain the 
least amount of information. In other words, they are plainly noise. We will 
mainly focus on the case where Y is Poisson. 

The asymptotics of waiting times for pattern detection using random 
templates have been studied for the case where X = {X„,n > 1} and Y = 
{Y„,n> 1} are integer indexed processes (cf. [2, 7, 13, 14] and references 
therein). In these works, the matching score is defined for (Xi,... ,X„) and 
(Yi,...,Y„) as the average of p{Xj,Yj) for some function p. Whereas the 
temporal relations between points are essential in the asymptotics considered 
here, it is apparent such relations are not relevant in the above results. 

When / is scalar-valued function /, the first main result is: 


Theorem 1. Suppose that X and Y are point processes on M that are 
independent of each other and f is a hounded scalar function. Assume: 

1. X is a stationary and ergodic point process with mean density 

N = ENx.[0, 1) G ( 0 , 00 ), 

where Xx(-) is the random counting measure associated with X (cf. [5]J. 

2. Pr{(i(0,X) is a continuity point of f| = 1. 

3. Pr{/(d(0,X)) >0} >0. 

4. Y is a Poisson point process with density A G ( 0 , 00 ). 

Define 

(1.1) cf:=XE[f{d{0,X))], 

(1.2) A(t) := -1]. 

Then, given 9 > cf, 

(1.3) lim --loglT;(0,X, Y) = sup{0t — A(t)} 

1^00 I t>o 


w.p.l. 
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Theorem 1 can be generalized to the case where the signal is a com¬ 
pound Poisson process. Such a process can be characterized as a pair Y = 
(Y, {Q{y),y € K}), where Y is a common Poisson point process with density 
A and Q{y) i.i.d. ~ Q G N are random variables independent of X and Y. 
For y ~ Y, each y G Y is interpreted as a location where there is at least one 
point, and Q{y) is the number of points at y. Then for Y ~ Y, the matching 
score between and the segment of Y in [t,t + 1), denoted by Y/+^, is 

= 7 E Q{y)f{d{y-t,xl,)). 

y&Yl+^ 


Proposition 1. Suppose all the assumptions in Theorem 1 are satisfied. 
In addition, suppose G(t) := E\e^^] < oo for all t>0. Then, given 9 > 6:= 
XE[f{diO,X))]E[Q], 

lim y loglYi(0,X,Y) = sup{0t — A(t)} w.p.l, 

1^00 I t>0 

where K{t) = XE[G{tf{dfi),X.))) — 1]. 

The asymptotic in Theorem 1 can also be proved when n = dim / > 1. 
Because the monotonicity property of M used in the proof of Theorem 1 is 
lost in this case, some changes in the assumptions are needed. 

Theorem 2. Assume X, Y and f satisfy all but condition 3 in Theo¬ 
rem 1. Instead, assume: 

3'. For any u / 0, Pr{(u, /(d(0,X))) > 0} > 0. 

Define A{t) = XE[ed’Icj) as in (1.1). Then for any 9 > 

(1.4) lim y logV17(d,X, Y) = inf A*( 2 ;) w.p.l, 

1^00 I z>9 

where 

A*{z) = sup{(^;, t)-A{t)} 

teM" 

is bounded and continuous. 

The proofs for Theorems 1 and 2 rely on the conditional large deviations 
principle (LDP) of a family of random variables, because X X is a fixed 
realization (cf. [2, 4, 7, 8]). These random variables have close relationship to 
Pi{Xq,Yq). We next consider the asymptotics of the latter and restrict our 
focus to the case where / is scalar-valued. First, the following approximation 
for the conditional LDP for pi(X q,Yq) holds. 
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Theorem 3. Under the same assumption as in Theorem 1, for any set 
of points 5 C M, let 


(1.5) AsAt) = { 


ylog.E 


exp' 


t f{d{y,S)) 




= 7/ 




- 1] dy, 


lo, 


ifS^0, 

otherwise, 


(1-6) A*s^i{0) = sup[6t - As,i{t)]. 

iSR 

Then, given 6 > (f, almost surely, for X X, 

(1.7) - logPr{pK4, Y') >9}- lA*^ije) = o{Vl). 

Note that Pr{p;(X^, Y(,) > 0} = Pr{lT;(0) = 0}. 


Remark. Despite the higher-order approximation in Theorem 3, the 
difference between the aforementioned random variables and pi{Xq,Nq) does 
not allow the approximation to be applied to the proof of Theorem 1 and it 
is not clear to me how to derive a similar higher-order approximation to Wi. 

Finally, under suitable conditions, — logPr{/9;(XQ, Yq) >9} after being 
centered and normalized is asymptotically normal, as the following result 
combined with (1.7) shows. 


Theorem 4. Assume X, Y and f satisfy all but condition 2 in The¬ 
orem 1. Instead, assume f ^ 0 is continuous. Given 9 > cj), let to be the 
{unique) point with A* {9) = 9to — A(to)- If X is a Poisson point process with 
density p, then almost surely, for X X, 

( 1 . 8 ) l{A*^i^i{9)-[9to-Axi^i{to)]} = o{Vl), l^oo, 

(1.9) V!{9to-Axt^i{to)-A*{9)) ^N{0,W), 
with 


( 1 . 10 ) 


Var< G 



- UE 


9 





+ <E 


G 


(- 

\2p 





where U ~Exp(l), g{x) = a^id G{x) = f^ g. 


Remark. Following the proof of Theorem 4, it can be shown that, in¬ 
stead of assuming X to be a Poisson process, if f^ 'if{t)dt < oo and ei¬ 
ther / has bounded support or < oo, where ^/’(t) = sup{|P(T n R) — 
P{A)P{B)\ : A G a{X^^), B G (t(X“)} and r = min(XQ°), then (1.8) and 
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the asymptotic normality of \/l{6to — A^i ^(to) — A*(0)) still hold. Indeed, 
under the assumptions, the left-hand side of (1.9) is \/n{Ax,n{to) ~ A(fo)) + 
o(l), w.p.l, with n= [l\, and the random variables Zn = X _ 

1] dy satisfy the mixing condition in [12], Theorem 1, yielding the asymptotic 
normality. However, in general, the explicit form of the limit distribution is 
not readily obtained. 


The rest of the article is organized as follows. In Sections 2 and 3, Theo¬ 
rem 1 is proved. In Section 4, Theorem 2 is proved. In Section 5, Theorem 3 
is proved. Finally, in Section 6, Theorem 4 is proved. 


2. Waiting times for scalar-valued matching scores. In this section, sup¬ 
pose X and Y satisfy the conditions in Theorem 1. For any function g, 
denote g~^ = max{g, 0) and g~ = max(—g, 0), and for e > 0, 

ge{x) = sup g{t). 

\t—x\<£ 


For integer n > 1 and X, Y C M with Y discrete, dehne 
An{X,Y) = - ^ inf /+(d( 2 /,X')) 

TJ ' * 'tn _1 < / < 


Tl ^n—KKn'' 

^ 1 j^gynn-l<Z<n 

1 


Bn,e{X,Y) = -- ^ sup /+(d(y,X')) 

~~ frid{y,X^Q)). 

71 n—l<t<Ti 


Since 


(2.1) /+(x)= sup /+(t)>/+(x), /^(x)= inf / (t) < / (x), 

\t-x\<e \t-x\<e 

it is seen that Bn,s{X,Y) > An(X,Y). The following lemmas are needed for 
the proof of Theorem 1. 


Lemma 1. Given 0 G M, almost surely, for X X, asn^oo, eventually 
there are 

an,x,9 := Pr{4l„(X, Y)>9}> 0, Pn,e,x,e := Pr{H„,.(X, Y)>9}> 0. 

Because of Lemma 1, the logarithms in the results below are well defined 
almost surely. 
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Lemma 2 (Upper bounds for Wi). Let 9 he an arbitrary number. Then 

( 2 . 2 ) Pr|limsupylog[appx,e x Wi{e,X,Y)] <oj = 1 . 

Lemma 3 (Lower bounds for Wi). Let 9 he an arbitrary number. Then 

(2.3) Prjlirninf ylog[/3piy£_x,0 x max(fU((9,X,Y), 1 )] > o| = 1. 

Lemma 4 (LDP). Almost surely, for Y ~ X, the conditional laws of 
An{X,Y), n>2, satisfy the LDP with a good rate function 

(2.4) A* (9) = siip{9t — A{t)}, 

teM. 

and the conditional laws of Bn^e{X,Y), n>2, satisfy the LDP with a good 
rate function 

A*(0) =sup{0f- - 1]}. 

teR 

Assume for now that the above lemmas hold. For 9 > by Lemmas 2 
and 4, almost surely, for X x,y 

(2.5) limsupy logVU(0,X, Y) < inf A*(z). 

1^00 I 

It is known that A is strictly convex (e.g., [9]). Because / is bounded, A is 
smooth everywhere with A'(0) = (j). By condition 3 of Theorem 1, A{t) —>oo 
exponentially as t—>oo. These imply that for any z> cf), A*{z) > 0 is finite 
and achieved on (0,oo), and A* is a continuous strictly increasing convex 
function on Then by (2.5), it is seen that 

(2.6) limsupylogWz(0,X,y) < A*(0), 

and to complete the proof of (1.3), it remains to show 

(2.7) l[mmf\\ogWi{9,X,Y)>A*{9). 

1^00 I 

By Lemmas 3 and 4, for any e > 0, 

liminf \\ogTaa.yi{Wi{9,X,Y), 1) > inf A*^{z). 

1^00 I z'>6 

Similar to the above argument, it is seen that almost surely, for X X, 

y ~ Y, 

(2.8) liminf - logmax(W/(0,X, Y), 1) > A*(0) = sup{0t — Ae(t)}, 

i->oo I t>0 
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where A^{t) = XE[e^A{dio,^)) _ Lg^ f* i^g ^];ig unique point where A*(9) = 
6t* — A{t*). Then A*(0) > 9t* — Ae(t*). By condition 2 of Theorem 1 and 
dominated convergence, A^{t*)^A{t*), leading to liminfe^o A*(6l) > A*{9) > 
0. So by (2.8) 

liminf y logmax(lTi(0, AT, T), 1) > A* (9) > 0. 

The lower bound also implies Wi[9,X,Y)^oo. These combined with (2.8) 
prove (2.7). □ 

3. Proofs of lemmas. 


Proposition 2. For X satisfying condition 1 of Theorem 1, 

Prllim 

[l^oo I J 

where, for Xq = 0, sup{x : x G Xq} is defined to be —oo. 


Proof. Because X is stationary and ergodic, almost surely, for a realiza¬ 
tion X of X, as /^oo, Nx[0,l)/l ^ N > 0, implying that for any e G (0,1), 
A'x[(l — —>oo. Now 


leading to 


I — sup{Xq} 

I 


>e 


Nx{{l-e)l,l) = 0, 


Pr 


I — supia; : x G Xq} 
lim sup- - - 

/ —> OO ^ 



= 0 , 


which completes the proof. □ 


Proof of Lemma 1. Because Bn,e ^ it is enough to show that 
almost surely, for X ~ X, an,x,e ■= Pr{A,i(X, Y) > 0} > 0 eventually, as 
n—>oo. Let X be a realization of X and = min(XQ“^), = max(XQ“^), 
for n > 2. It is easy to see Sn/n^O w.p.l. By Proposition 2, almost surely, 
Tn is well defined for all large n and {n — Tn)/n^0. Note that for y G Yff, 
d{y,XQ~^) = d{y,X). By the ergodicity of X and condition 3 of Theorem 1, 
almost surely, 

hfid{y,x))>0}dy 

X 

n io ^^Ad{YX-y))> 0 } dy 
APr{/((i(0,X)) >0} >0. 


lim E 

n —> OO 


n 


Z! l{/(d(y,Ao"-i))>0} 
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Then it is seen that for n large enough, there is > 0 such that 

Prj- E /+(%,^o“'))>^n|>0. 

Define 

Cn=lY:Y,^ = Y;:,- /(%,X--'))>r?n 

I ” yeY- 

and VyGyo",/(%,^o”'))>o|. 

By the property of Poisson processes, it is not hard to see that Pr{Y G Cn] > 
0. Fix G N with N > 9/r]n- Let consist of all Y with Y(^ being the union 
of Zi n [0, n), ..., Z]\f n [0, n) for some Zi,..., Zj\i G Cn with ZiCiZj H [0, n) = 
0, i ^ j. Then Pr{Y G Dn} > (Pr{Y G Cn})^ > 0 and for any Y G 
An{X,Y)>Nr]n>e. □ 


Proof of Lemma 2. Let {Kn} be a sequence of positive numbers to be 
determined later. Fix n > 2. Let Y be a realization of X with an,x ,9 > 0 and 
Y a realization of Y. If there is ^ G (n — l,n], such that Wi{6,X,Y) > Kn, 
then for all t G [0, Kn ], 


7 E f{d{y-t,xi))<e 

yeYl+^ 

^ 7 E /+(<i(y-L4)) 


<^ + 7 E r{d{y-t,xi)) 



<e + 


1 

n — 1 



sup / {d{y-t,Xl)) 

n—l<l<n 


An{X,Y-t)<0, 


with (a) due to / >0. In particular, Wi{9, X, Y) > Kn implies An{X,Y — 
kn) <6 for A; = 0,..., [iL„/nJ. Because An{X, Y — kn) only depends on X 
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and by the fact that are i.i.d., 

Pr{3^e (n- l,n] s.t. Wi{e,X,Y) > Kn} 

r \Knln\ 

<Pri f| {A^iX.Y -kn)<e} 

I k=0 

[Kn/n\ 

= n Pr{A„(X, Y -kn)<e}<{l- an,x,e)^-'" < 

k=0 

Choose Kn = c{n)n/an^x,ei with <oo and blogc(n)—>0. Then 

Prja^e (n- l,n] s.t. ylog[a„,x,e x Wi{e,X,Y)] > ylog[c(n)n]| < 

Because the above bound is uniform over X with an,x,e > 0 and summable, 
by the Borel-Cantelli lemma and Lemma 1, (2.2) is therefore proved. □ 


Proof of Lemma 3. Fix n > 2, e G (0,1) and L > 0. Let X be a re¬ 
alization of X with (5n,e,x,e > 0 and let T be a realization of Y. If there is 
/ G (n — l,n] such that Wi{9,X,Y) < L, then there is r G [0,L] such that 

y ^ f{d{y-T,X^,))>d, 

yeY^+‘ 


which implies that for some t = ke, /c = 0,1,..., [L/e \, 

7 sup fid{y-T,XQ))>9. 

re[t,t+d 


Since for any r G [t,t + e], ^ C YJ^'' C , the above equality leads 

to 

sup f^id{y-r,Xl^)) 

" ^ T£[t,t+£] ^^yt + n+e 


- i inf y 

n T&[t,t+6] 


r{d{y-T,Xi))>9. 


Because \d{y — t,Xq) — d{y — t, Yq)| < e for any y G M and r G [t,t + e], 
by (2.1), the above inequality implies 

^ y /+(d(y_t,y))_i y f-{d{y-t,xi))>9 

n — 1 ^ , n ^ , 

y^yt + u+e y&ltr 

Bn,e{X,Y-t)>9. 
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Because t = ke, for some A: = 0 , 1 ,, [L/e \, by the stationarity of Y, 

Pr{ 3 /E(n-l,n] s.t. Wi{9,X,Y)<L} 

f lL/e\ 'I 

<Fil U {Bn,eiX,Y-ke)>e}'> 

[ k =0 ) 

lL/e\ 

< Y. Pv{Bn,e{X, Y-ke)>e} = {L/e + l)l3n,e,X,e. 

k=0 


For L > 1 , this implies 

Pr {3 / G (n - 1 , n] s.t. max{Wi{9, X, Y), 1 ) < L} < 2L[3n,e,x,e/£- 

The above bound holds for L E ( 0 , 1 ) as well. Choose L = Lin) = /(5n,e,x,e 

with X] < oo and ^ 0 to get 

PrjaZ E (re - l,re] s.t. j\og[f5n,e,x,e x max(iyi( 6 »,X, Y), 1 )] < 


By an argument similar to the end of the proof of Lemma 2 , ( 2 . 3 ) is proved. 

□ 


Proof of Lemma 4 . The proof is an application of the Gartner- 
Ellis theorem. We will only consider the LDP of An{X,Y). The LDP of 
Y) can be similarly treated. 

The first step is to show that almost surely, for X X, 

( 3 . 1 ) - log ^ Ait) for all t E M. 

re 

Let gn{y) = infn-i<i<nf^(.d{y,X^Q)) and h„(y) = sup„_i<,<„/-((i(y, Y^,)). 
Then given t E M, 


-logE[e”*^-(^’Y)] = -logF; 
n n 


exp<t( Y 9n{y)-:^^^ Y 




yeYg 


= /l + h, 


with 


h = 
h = 


A 


cn—1 ' 


n Jq 
A ^ 
n Jn-l 


re 


exp<{ t( gn{y) - ■:^^^hn{y) U - 1 


dy, 


exp 


tn 

re — 1 


hn{y) \ - 1 


dy. 
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Because / is bounded, I 2 —>0 as n—>00. Letting = min(XQ ) and Tn = 
max(XQ“^), it is seen that if < y < t„, then d{y,XQ) = d{y,X), yielding 
9niy) = f^id{y,X)) and hn{y) = f~{d{y,X)). Let 


F(y) =exp|t(^/+((i(y,X)) - (d(y,X))^| - 1. 


Clearly s„/n^0. By Proposition 2, we can assume (n —r„)/n^0. Let 
Jn = [ 0 ,Sn] U [r„,n — 1]. Then by the boundedness of /, as n—>00, 


rn—1 


h = - 

n Jo 


F-- 
n Jjr, 


F + 


- f exp\t(gn{y) 
nJjr^l I V 


n 


n — 1 


K{y) I 1 -1 


dy 




n 


n — 1 


f-{d{0,X-y)))\-l 


dy + o{l). 


Because X is ergodic, it is seen that Ji ^ — 1], proving (3.1) 

for fixed t. It follows that almost surely, (3.1) holds for t in a countable 
dense subset of M. On the other hand, by the boundedness of /, it is not 
hard to show that ^ n > 1, are equicontinuous functions 

in t on any bounded region and A(t) is continuous. Therefore, almost surely, 
for X ~ X, the convergence in (3.1) holds for all t G M. 

The function A(t) is smooth and strictly convex. By condition 3 of The¬ 
orem 1, A(t)— >00 exponentially fast as t^oo. To finish the proof, consider 
the event E = {f{d{0,X)) < 0}. If Pr(i?) > 0, then, as t —> — 00 , A(t) — >00 ex¬ 
ponentially fast and hence A is essentially smooth (cf. [[9]], Definition 2.3.5). 
By the Gartner-Ellis theorem, the LDP holds for A„(X, Y) with the good 
rate function A*. If Pr(E) = 0, or equivalently, f{d{0,X)) > 0 w.p.l, then 
by Theorem 2.3.6 and Lemma 2.3.9 of [9], for any open set G, 

liminf — logPr{A„(X, Y) G G} > — inf A*(a). 

n^oc n aSGnfO.cxD) 


Since for a < 0, A* (a) = 00, and for 0 < a < (/>, A* (a) < 00 is decreasing, the 
above inequality implies 

liminf — logPr{A„(X, Y) G G} > — inf A*(a). 

n—>00 71 a£G 

Therefore the LDP is proved. □ 


4 . Waiting times for vector-valued matching scores. Let comparison or 
maximization of vectors be made component-wise, for example, if / = (/i,..., fn), 
then /+ = (/+,..., /^), sup^g^ f{x) = (sup^g^ /i(x),..., sup^g^ fn{x)), and 
for vectors u = (ui,..., u„), v = {vi, ..., u„), max(u, v) = (max(tti, ui),..., max{un,Vn))- 
Given 6 G M"", define Wi{0, X,Y) as in the case where / is scalar-valued. 
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Proof of Theorem 2. Lemmas 1-3 still hold. Following the proof for 
Lemma 4, 

(4.1) 

n 

Let C = /(c^(0,X)). Since A(f) < oo on M” and is differentiable, to show 
that the laws of Y) follow the LDP with the good rate function 

A*(z), by the Gartner-Ellis theorem, it is enough to show that |VA(f)| = 
—>oo as |f| —>oo. Assume for a sequence tj G M”' with |fj| —>oo, 
|£'[Ce^b’0]| < M. Then there is a subsequence of Tj := tj/\tj\ converging to 
some V with |u| = 1. Without loss of generality, assume the whole sequence 
Tj converges to v. Then \E[{v, C)e^b’0]| < M. By condition 3', there is e > 0 
such that Pr{(u, () > 3e} > 0. Because / is bounded, for j large enough, 
Id — t’llCI < £• Then 

\E[{v, > E[(u, + ^[(d C)e<*-^>l{(.,c><0}] 

>E[{v, 

+ E[{v, 

> 3ePr{(u, C) > -^oo, 


which is a contradiction. 

Let M{t) = E[e^^’‘^'^]. For any a > 1, let F = {t :M{t) < a}. Because M{t) is 
convex and continuous, F is a convex closed set. Assume F is unbounded, 
then there are tj G F with |tj| — >00 and Tj = tj/\tj \ -^v for some v with 
length 1. Given r > 0, |tj| > r for all large j. As 0, |fj|rj G F, rTj G F, imply¬ 
ing rv G F. As a result, M{rv) < a for all r > 0, which is impossible due to 
condition 3'. Therefore, F is bounded. Suppose |u| < R for all u G F. Then 
for t with |t| > R, by the Holder inequality, M{t) > 

and hence A{t) = M(t) — 1 —>00 exponentially fast in |t|. Therefore, A*{z) < 
sup^g]jj{|z||t| — A(t)} is bounded on any bounded set. Since A* is convex, 
then it is seen A* is continuous. 

By (2.2) and the LDP for the conditional laws of A„, almost surely, for 
Y ~ X and F ~ Y, 


(4.2) 


lim sup T log Wi(e,X,Y)<- lim inf - Pr{A„(X, Y) > 6} 
1^00 I n 

< inf A*(2;) = inf A*(z), 
z>e z>e 


with the last equality due to the continuity of A*. For z >9 > cj), { 1 , z) > 
(1, 9) > (1, (p) = A£’[(l, (■)]• Then by Theorem 1 

A*(z) > sup{f(l, z) - - 1]} > sup{t(l, 9) - - 1]} > 0. 

t>o t>o 
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On the other hand, by the Gartner-Ellis theorem, 


(4.3) 


liminf \ logmaxjl, Wi{9,X,Y)} > — limsup — Pr{i?„ ^(X, Y) > 6} 
/->oo I n^oo n ’ 

> inf A*(2:). 


Similarly to the proof for Theorem 1, it just remains to show 


(4.4) lim inf A*(z) = inf A*( 2 ;), 

where A*(z) =supigR{( 2 :, t) — AG(0Y))> _ 

Let M = sup 2 ,>o |/(x)|. Since 

A*(z) > sup{|2|t — ^oo, |z|^oo, 

i>0 

uniformly for e > 0, for some bounded closed set^c{2;:z>0}, inf^^g A* {z) = 
inf^g^ A*(z). Next show that as a family of functions parameterized by e > 0, 
A* is equicontinuous on A for all small £. 

By the boundedness of / and conditions 2 and 3', for any v = {z ■.\z\ = 1}, 
there are ?? = r/(u) > 0, (5 = 5{v) > 0, and an open neighborhood U = U{v) C 
r, such that 


Pi{{v, fe{d{0,X.))) > 2r]} > rj for all e < (5 

and M\v — u| < r/, for all u G U. Because T is compact, there are vi,... ,Vn 

such that r = Ufe=i U{vk)- Let 6 = minfc=i 5{vk) and i] = min^^j^ f]{vk)- For 

any u £ L, there is k such that v G U{vk)- Then for any £ <5, when {vk, f£{d{0,X))) > 

2f?(^^fc), 

{vJe{d{0,X))) > {vkfeid{0,X))) - \v-Vk\XI >2T]{vk) -r]{vk) > ??, 

implying Pr (u, /^(^(O, X))) > r] > r]. Fix L > 0 such that \z\ <L for all z G A. 

For t G R \ {0}, write t = \t\v. Then as \t\ —>oo, 

(z, t)-AF[e<*’A(d(o,x))>_^j 

< L\t\ - A£|{el‘l<”-/.W»-X))) _ + A 

< L\t\ — + A—> —oo, 

uniformly for z G A and £ < 5. Since A*(z) > 0, this implies that there is 
R> 0 such that for all z G A and £ <6, the maximizer t*{z,£) of {z, t) — 

AF[e^*’A('^(0X))) _ xj ig := {z: \z\ < R}. Then for any zi,Z 2 G A, it is 

seen A*( 2 i) — X*^{z 2 ) < {t*{zi,£), zi — Z 2 ) < R\zi — Z 2 \- Likewise, A*(z 2 ) — 

A*( 2 : 1 ) < R\zi — Z 2 \- So A*{z) is equicontinuous. 

Choose £n such that lim„ inf^^g A* (z) = liminfe_>o inf^>£) A*( 2 ;), where 
A* := A*^. Let G A be such that A* (z^) = inf^g^l A* (z). Then Zn has 
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a convergent subsequence. Without loss of generality, suppose Zn^ z G A. 
Following the same argument as in the proof of Theorem 1, A^{z)^A*{z). 
Then by the equicontinuity of A*, 

liminf inf A*(z) = lim A*(zn) = lim A* (z) = A^fz) > inf A*!^) > 0. 

z>6 n— >CXD n—>c» z>9 

Therefore, (4.3) can be replaced by 

liminf \\ogWi{6,X,Y) > inf A*{z). 

/—>00 I z'>6 

This together with (4.2) implies that 

lim sup inf A*{z) < inf A* (z), 

e —>0 

which completes the proof of (4.4). □ 

5 . An approximation for large deviations. Given 0 >()>:= A£^[/(d(0,X))], 
it is easy to see that 6t — A{t) achieves A*(6) at a unique point to- Further¬ 
more, to S (0,oo) and 

(5.1) 0 = A'(to) = A.F[/((i(0,X))e‘°^('^(°’^))]. 

Lemma 5. Almost surely, for X ~ X, when I is large, 6t — A^i ^(t) 
achieves A* i [6) on (0,oo) and the maximizer t* =t*{X,l) is unique. Fur- 

Ao,t 

thermore, t* satisfies 

(5.2) e = A'^,^{n = j tf{diy,Xl,))e^*f^^<^y’^o))dy 

0’ t JO 

and, as 1 ^ 00 , t*^to, A^i ,(t*) —> A(to) and A" ; (t*)—>A"(to). 

^0’^ Aq,! 

Proof. Almost surely, for X ~ X, for all large I, A^i^fit) is smooth, 
strictly convex, A^i^fiO) = 0, and A'^i ^(t)—>oo exponentially fast as t—>oo. 
Furthermore, following the proof of Lemma 1, 

lim j [ f{d{y,Xo))dy= lim j j f{d{y,X))dy = E[f{d{Q,X))]. 

1^00 L JO l^oc L Jo 

and hence X^i ^(0) < 6, implying 9t — A^i fit) has a unique maximizer t* 
which is in (0,oo). By differentiation, (5.2) is proved. For any t > tg, by 
(5.1) and (5.2), as t—>c», 

A^./t)-A'(t)>A'(to) = d = A^./f). 
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Therefore, t* <t eventually, giving lim sup^ ^ ^ ^o- Likewise, liminf;^oo t* > 

to- This proves t*—>to- Finally, following the equicontinuity argument as in 
the previous sections, 

lit*) = y - 1] = A(to) 

I Jo 

and 

lit*) = jt f{d{y,Xi,))e^*J^^(y’^o)) dy 

0’ t JO 

XE[fidiO, = A" (to) >0. □ 

Proof of Theorem 3. Given X ~ X such that Aj^i ^ has the properties 
described in Lemma 5, let 

J; = exp(tA^,/0))Pr| ^ fidiy,Xi))>ie 

First, because J; < exp(/A^,^^(6»))£’[exp{t*(X;j^gY^/((i(y,X(|)) - W)}] = 1, 
we have 

limsup log J; < 0. 

It remains to show that 

(5.3) liminf ^log > 0. 

1^00 ^/l 

For I > 0 large enough, let g{y) := f{d{y,XQ)). Let t* > 0 be the maximizer 
of 6t — lit) as in Lemma 5. Define measures u = i and /r = ^ on 

[0,1], respectively, by 

and df,fe) = AM, 
dy K 

with K = /g duiy). Then // is a probability measure. It is easy to see that 

(5.4) K = liAxi^ iit*) + X)=li9t*-A*j^i^ iie) + \) and W = KE[gi^)], 
with ^ ~ /x. Also, 

(5.5) y =AY*/t*) + A^A(to) + A = A.F[e*“'^('^(°’^»]>0 asl^oo. 
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Letting m = E[g{^)], by (5.4) and the properties of Poisson processes, 

. ( n 


lA* , (6») °° 
Ji = e <’ 


I f 


lA* , ie)-xi+K 


= e ^0’* 


i,,» Lel. »(..)>«-) 

\et*9{yi) 


n 

xn 

2=1 


K 


dyi--- dyn 


= e 


jet* -K^ 


E' 

n=0 




n! 




2 = 1 


.-A' 




e -—E 
n\ 


= E 

n =0 

with i.i.d.~;U 




exp< -t*Y^{g{ii) - 


m) 


i=l 


J*{K- 


Fix 5 > 0. Recall t* > 0. If m > 0, then 


Ji> 


E 




ni 


)>o} -t* E(ff(^*) - 


2 = 1 


— t* y/KinS 


X e 

A similar bound can be obtained when m < 0, by summing over K — 6^/K < 
n< K instead. Without loss of generality, assume m > 0. Let 

^ sr=i(g(6)-m) 

yjn\ai[g{i)\ 

Let /—>oo. Then t*—>to ^md by (5.5), AT—>oo. There is a constant ci = 
Cl ((5) > 0, such that for large K, Yl,K<n<K+5'/K^~^/'n'- — *^1 hence 


i^<r2<iC+5\/F 


n! 


> y Pr{0 < < 5}e-‘V2^Var[3«)]5g-Cv^r„5 

^ n! 

K<n<K+5\^ 


> Cl min Pr{0 < < (5}e 

K<n<K+&%/K 


-t* s/KD5 


with D = a/ 2 Var[ 5 r(^)] + m. It is not hard to see that for ^ ~ /r and g = 

/(d(0,X)), 


Var[5r(0] = 


_ Io9^{y)e**^^^^ dy f /p ff(j/)e**g(^) 


/o e‘*3G) dy 


fg e^*9(y) dy 
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E[e^orjj V E[e^ov] ) 

and hence Var[( 7 (^)] is uniformly bounded below from 0 for all large 1. Be¬ 
cause g{y) = f{d{y,XQ)) is uniformly bounded, Gn satisfy Lindeberg’s con¬ 
dition, giving Gn A1(0,1). Together with (5.5), these imply that there is 
a constant C 2 > 0 which is independent of I and 5, and some p = p{5) > 0, 
such that Ji > yielding 

liminf —= log Ji > —C 2 toS. 

«->oo ^/l 

Because 6 is arbitrary, (5.3) is proved. □ 

6 . Asymptotic normality. 


Proof of Theorem 4. From Lemma 5, it is seen that almost surely, 
for large I > 0, there are unique Ti,ti > 0 with AV i = 9ti — A{ti), A* i (0) = 
6ti — Aj^i^ Furthermore, as /—>oo. Fix 6,AI >0, such that 

Tpti G (to — 5,to + <5) for all large I > 0 and X\e^Ad-{yXo)) — 1| < M/2 for 
t G (to — 5, to -|- 6) and all y. Following the argument in the proof of Lemma 1, 
on {to - 5, to + 6), 

(6.1) |Ax,Ki) - Ax'/i)l < (mm(A(,) -h di)M/l, 

where di = I — max(AQ). Clearly, min(AQ) = 0(1) w.p.l. Letting n = [tj, 

di < Sn = n + 1 — max(A!!gj 3 ) = 1 — max(A£g^) = 1 + pU, with U ~ Exp(l). 
Given e > 0, Pr{s„ > ^/En} < Pr{(C/ + 1)^ > en}. Since EU'^ < oo, applying 
the Borel-Cantelli lemma to Sn, it is seen that di = o{-\/l)^ w.p.l, and hence 
the left-hand side of (6.1) is o{l/Vl) w.p.l. Then, by ti,Ti G (to — <5,to + 6), 

|Ax,/(6') - A;;^* ( 6 »)| < sup \Ax,i{t) - Aj^i ,{t)\=o{l/Vl) 

\t-to\<s 

(6.2) 

w.p.l. 

On the other hand, it is easy to see that for large I > 0 and n= [l\, 

(6.3) \Ax,i{t) — Ax,n{t)\ 

for all t £ {to — 6, to + S). In particular, letting t = r^, t; leads to 

(6.4) \A*^ {e)-A*x^M< sup |A^,/t)-Aw/t)|<2M/L 

|t-to|<<5 ° “ 

From (6.1)-(6.4), it is seen that (1.8) holds if we can show 
Zn — ^y^[9{T~n ^o) (Ax,n ('Ll) Ax,n(^o))] — o(l) 


w.p.l. 
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Since Zn = „(0) — {9to — Ax,n{to)) > 0, it is enough to prove limsup^;^ < 0, 

or equivalently, 

(6.5) liminf Vn [Ajis:,n('rn) - Ax,n(io) - 9{Tn - to)] > 0. 

n —> CO 

Because G (to — <5, to + S) and Ax,n(t) is smooth, by Taylor’s expansion, 
for some t* G (to — (5, to + <5), 

Ax,n(t) - AxAto) - 0{t - to) = An{t - to) + > -77^^, 

where 

1 

An = - f{d{y,X))e^°fWy,x))^y_g^ 

n Jo 

1 pn 

Bn,t = - dy > 0. 

n Jo 

Because / is bounded and X is ergodic, there exists a constant r/ > 0, such 
that Bn,t > "n for all large n and t G (to — 5, to + S). The random variables 

pn 

Zn= f{d{y,X))e^^Bd{y,x))^y 

J n—1 

are bounded and form a stationary process such that An = ^Yllt=i^k — 9. 

Since to maximizes 9t — E[e^Bd{o,x.))j^ q _ E[f[d{ 0 ,X))e*°Bd{o,x))j _ j^^n- 
Let a{k) := sup{|P(FinF 2 )-P(Fi)P(F 2 )| :Fi G a{Zn,n< m), F 2 G a{Zn,n > 
m + k), m> 1}. We shall show oi{k) < 00 , once this is done, it follows 
that \/nA^—>0 almost surely (cf. [12], Theorem 2). Then the left-hand side 
of (6.5) is bounded below by liminf(—y^A^/27/) =0, which completes the 
proof of (1.8). 

Given A; > 1, for any m > 1, let 

-^ = l{Xn(m,m+fc/3)^0} and J = l{Xn(m+2fc/3,m+fe)7^0}• 

From the definition of it is seen that when 1 = 1, for n<m, Zn only de¬ 
pends on Therefore, for any event Fi G a{Zn, n < m), Ti n {/ = 1} G 

(7(X(](^^^^). Likewise, for any event F2 G a{Zn,n > m + k), T 2 Cl { J = 1} G 

(7(X^_i_ 2^^3). Consequently, by the property of Poisson processes, P{Fi n F 2 , 1 = 1, J = 1) = P{Fi,I = 1). 
Because X is stationary and has density p> 0, 

0 < P{Fi n F 2 ) — P{Fi n F 2 ,i = 1, j = 1) 

< P{I = 0} + P{J = 0} = 2P{X n [0, fe/3) = 0 } = 

and similarly, 0 < P{Fi)P{F 2 ) — P{Fi,I = 1)P{F2, J = 1) < There¬ 
fore, |P(TinF 2 ) —P(Ti)P(T 2 )| leading to X]«(A;) < 4^] < 00 . 
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By (6.1) and (6.3), in order to show (1.9), it is enough to demonstrate 
y/n{eto - Ax,n{to) - -^*{0)) ^ N{0,4pa‘^), or 

^ (i) ~ ^ 


where ly = E[g{d{0,'K))]. Because d(0,X) ~ , with U ~Exp(l), 


u = E 


U 
9\ 77- 


2pJ\ 


= 2pE 


G 


(-, ■ 
\2p)\ 


For Xg = {xi,... ,xn}, with Xi < Xj+i, letting xq = 0, xn+i = n and I = 

E N 

i=0^[ 2 

pn 

/ g{d{y,'K.))dy 


rxi 1 i.[xi+Xi+i)/2 rn 

= 9{y)dy + 2 22 9{y-Xi)dy+ g{y-XN)dy 

Jo Jxi Jxff 

= 21 + G{xi) + G{n — xn) — 2G{xi/2) — 2G{{n — xn)/2). 

The last four terms are so it suffices to consider 21. Given a specific 

value of N, 

nUo n{Uo + Ui) n{Uo + Ui + --- + Un)\ 

’ (X + 1)I7 7’ 


{xi,X2,. . . ,Xn) 


{N + 1)U {N + 1)U 


with Uo ,..., Un i.i.d. Exp(l), and Un = tv+T T.k=o Uk- So by Taylor’s ex¬ 
pansion, 

N 

I = T.G 

i=0 
N 


nUi 


2{N + 1)Un 

N 

' 9 




i=0 

N 


i=0 




go(H) + (iv + i)^„ 


i=0 

N 

= E 

i=0 ^ 


n(l-0Ui _^ 

2(N + l)Ujv 2(N + l)I7jv 

np 


np 


=-1 


{N + 1)Un 


2p 


L(iV + l)17,v 


- 1 


G 


Ui\ A 


N 


C- , - 

\2pJ Un 


m - 1 ) 


+ ^{np- N -1), 
U N 


where ^ G (0,1) and 


N 


An = 


n{l-m 


N+1^^\2{N + 1)Un ' 2{N + 1)UnJ2p 


+ ■ 




Ui 
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Therefore, 


nv\ D 1 


N 


. AT V 2 / - ^ ^ 


z=0 *- 


G 




N + 1 — np / u A]\f 


n 


As n- 


►oo, (A^ + 1 — np)/yTp ^ N{0, 1). And as m^oo, Um A 


1, A, 


E[g{^)^] (because g is continuous). These combined with CLT then give 

( 1 . 10 )" 

□ 
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